Optimization in Knowledge-Intensive Crowdsourcing

We present SmartCrowd, a framework for optimizing collaborative knowledge-intensive crowdsourcing. SmartCrowd distinguishes itself by accounting for human factors in the process of assigning tasks to workers. Human factors designate workers' expertise in different skills, their expected minimum wage, and their availability. In SmartCrowd, we formulate task assignment as an optimization problem, and rely on pre-indexing workers and maintaining the indexes adaptively, in such a way that the task assignment process gets optimized both qualitatively, and computation time-wise. We present rigorous theoretical analyses of the optimization problem and propose optimal and approximation algorithms. We finally perform extensive performance and quality experiments using real and synthetic data to demonstrate that adaptive indexing in SmartCrowd is necessary to achieve efficient high quality task assignment.Comment: 12 page

Innovation Labs: Leveraging Openness for Radical Innovation?

A growing range of public, private and civic organisations, from Unicef through Nesta to NHS, now run units known as “innovation labs”. The hopeful assumption they share is that labs, by building on openness among other features, can generate promising solutions to grand challenges of systemic nature. Despite their seeming proliferation and popularisation, the underlying innovation principles embodied by labs have, however, received scant academic attention. This is a missed opportunity, because innovation labs appear to leverage openness for radical innovation in an unusual fashion. Indeed, in this exploratory paper we draw on original interview data and online self-descriptions to illustrate that, beyond convening “uncommon partners” across organisational boundaries, labs apply the principle of openness throughout the innovation process, including the experimentation and development phases. While the emergence of labs clearly forms part of a broader trend towards openness, we show how it transcends established conceptualisations of open innovation (Chesbrough et al., 2006), open science (David, 1998) or open government (Janssen et al., 2012)

The Dawn of Crowdfarms

Some small companies are making crowdwork part of their formal business via teams that can complete multifaceted, complex tasks requiring specialized expertise

Tasks of a Different Color: How Crowdsourcing Practices Differ per Complex Task Type and Why This Matters

Crowdsourcing in China is a thriving industry. Among its most interesting structures, we find crowdfarms, in which crowdworkers self-organize as small organizations to tackle macrotasks. Little, however, is known as to which practices these crowdfarms use to tackle the macrotasks, and this goes hand in hand with the current practice of the HCI research community to treat all forms of complex crowdsourcing work as practically the same. However, macrotasks differ substantially regarding structure and decomposability. Treating them under one umbrella term - macrotasking - can lead to an imprecise understanding of the workforce involved. We address this gap by examining the work practices of 31 Chinese crowdfarms on the four main macrotask types, namely: modular, interlaced, wicked, and container macrotasks. Our results confirm essential differences in how these nascent crowd organizations address different macrotasks and shed light on what platforms can do to improve the uptake of such work

Technology-Powered Strategies to Rethink the Pedagogy of History and Cultural Heritage through Symmetries and Narratives

Recent advances in semantic web and deep learning technologies enable new means for the computational analysis of vast amounts of information from the field of digital humanities. We discuss how some of the techniques can be used to identify historical and cultural symmetries between different characters, locations, events or venues, and how these can be harnessed to develop new strategies to promote intercultural and cross-border aspects that support the teaching and learning of history and heritage. The strategies have been put to the test in the context of the European project CrossCult, revealing enormous potential to encourage curiosity to discover new information and increase retention of learned information

D2.1 Crosscult Pilot Specifications

The report presents a collaborative effort of the four pilots, which took place in the first six months (M1-M6) of the project and focused on: 1) refining the original scenarios, 2) capturing the requirements, 3) defining the evaluation framework, 4) identifying the contributing technologies, 5) specifying the core gameplay for the four pilots and 6) outlining the ethical guidelines for experts